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Abstract 



We consider the joint distribution of real and imaginary parts of eigenvalues of 
random matrices with independent real entries with mean zero and unit variance. We 
prove the convergence of this distribution to the uniform distribution on the unit disc 
without assumptions on the existence of a density for the distribution of entries. We 
assume that the entries have a finite moment of order larger than two and consider 
the case of sparse matrices. The results are based on previous work of Bai, Rudelson 
and the authors extending results to a larger class of sparse matrices. 



1 Introduction 

Let Xjk, 1 < j,k < oo, be complex random variables with EXj^ = and EjXjfcp = 1. For 
a fixed n > 1, denote by Ai, . . . , the eigenvalues of the n x n matrix 



X = (X„ (j, k) , Xn {j, k) = -^X.jk , for 1 < j, k<n, 



(1.1) 



and define its empirical spectral distribution function by 

1 " 

Gn{x,y) = - '^I{Rc{Xj}<x,lm{\j}<y}, (1-2) 



n 



where I^^y denotes the indicator of an event B. We investigate the convergence of the 
expected spectral distribution function KGn{x,y) to the distribution function G{x,y) of 
the uniform distribution over the unit disc in M^. 
The main result of our paper is the following 
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Theorem 1.1. Let Xjk be independent random variables with 

EXjk = 0, E = 1, and E \Xjk\^^{Xjk) < x, 

where (p{x) = (ln(l + for some rj > 0. Then EG„(x,y) converges weakly to the 

distribution function G{x,y) as n ^ oo. 

We shall prove the same result for the follows class of sparse matrices. Let Ejk, 
j,k = l,...,n denote Bernoulli random variables which are independent in aggregate 
and independent of (^jfc)j'fc=i with pn := Fi{ejk = !}• Consider the matrix X^"^) = 

-^=={ejkXjk)Jj^^-^^. Let X^[\ . . . , An denote the (complex) eigenvalues of the matrix X*^"^) 

and denote by Gn ^x, y) the empirical spectral distribution function of the matrix X^"^), i. 
e. 

1 

Theorem 1.2. Let Xj^ be independent random variables with 

EXjk = 0, E \Xjkf = 1, and E \Xjk\^^{Xjk) < x, 

where '^{x) = (ln(l + |x|))"'^^''~'', for some rj > 0. Assume that p^^ = 0{n^~^) for some 
I > e > 0. Then EG^n\x,y) converges weakly to the distribution function G{x, y) as 
n — > CO. 

Remark 1.3. The crucial problem of the proofs of Theorems 11.11 and 11.21 is to bound the 
smallest singular values si{z) of the shifted matrices X — and X^^-* — zl. These bounds 
are based on the results obtained by Rudelson and Vershynin in [21]. In our preprint [10] 
we have used the corresponding results of Rudelson [20] proving the circular law in the 
case of i.i.d. sub-Gaussian random variables. In fact, the results in [10] actually imply 
the circular law for i.i.d. random variables with E|Xjyfc|^ < X4 < cxo in view of the fact 
(explicitly stated by Rudelson in [20]) that in his results the sub-Gaussian condition is 
needed for the proof of Pr{||X|| > K} < Cexp{— cn} only. Restricting oneself to the 
set i^n{z) = {•si(^;) < cn~^; ||X|| < K} for the investigation of the smallest singular 
values, the bound Prjr^n'^''} < cn~2 follows from the results of Rudelson [20] without the 
assumption of sub-Gaussian tails for the matrix X. A similar result has been proved 
by Pan and Zhou in [15] based on results of Rudelson and Vershynin [21] and Bai and 
Silverstein [3]. 

The circular law assuming less restrictive moment condition of order larger than 2 only 
and comparable sparsity assumptions was proved independently by T. Tao and V. Vu in 
|25j based on the results of [26] in connection with the multivariate Littlewood Offord 
problem. 

The approach in this paper though is based on the fruitful idea of Rudelson and 
Vershynin to characterize the vectors leading to small singular values of matrices with 
independent entries via 'compressible' and 'incompressible' vectors, see j21j . Section 3.2, 
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p. 15. For the approximation of the distribution of singular values of X — zl we use a 
scheme different from the approach used in Bai |T]. 

The investigation of the convergence the spectral distribution functions of real or com- 
plex (non-symmetric and non-Hermitian) random matrices with independent entries has 
a long history. Ginibre's in 1965, [7], studied the real, complex and quaternion matrices 
with i. i. d. Gaussian entries. He derived the joint density for the distribution of eigen- 
values of matrix. Applying Ginibre formula Mehta in 1967, [17] determined the density of 
the expected spectral distribution function of random matrix with Gaussian entries with 
independent real and imaginary parts and deduced the circle law. Pastur suggested in 
1973 the circular law for the general case (see jH], p. 64). Using the Ginibre results, 
Edelman in 1997, [5] proved the circular law for the matrices with i. i. d. Gaussian entries. 
Rider proved in [21] and [23] results about the spectral radius and about linear statistics 
of eigenvalues of non-Hermitian matrices with Gaussian entries. 

Girko in 1984, [6], investigated the circular law for general matrices with independent 
entries assuming that the distribution of the entries have densities. As pointed out by Bai 
[T], Girko's proof had serious gaps. Bai in [l] gave a proof of the circular law for random 
matrices with independent entries assuming that the entries had bounded densities and 
finite sixth moments. His result does not cover the case of the Wigner ensemble and in 
particular ensembles of matrices with Rademacher entries. These ensembles are of some 
interest in various applications, see e.g. [27] . Girko's [6] approach using families of spectra 
of Hermitian matrices for a characterization of the circular-law based on the so-called 
V-transform was fruitful for all later work. See, for example, Girko's Lemma 1 in [1]. In 
fact, Girko [6] was the first who used the logarithmic potential to prove the circular law. 
We shall outline his approach using logarithmic potential theory. Let ^ denote a random 
variable uniformly distributed over the unit disc and independent of the matrix X. For 
any r > 0, consider the matrix, 

X(r) = X - r^I, 

where I denotes the identity matrix of order n. Let fin^ (resp. be empirical spectral 
measure of matrix X(r) (resp. X) defined on the complex plane as empirical measure of 
the set of eigenvalues of matrix. We define a logarithmic potential of the expected spectral 
measure fin\ds , dt) as 

C/M(^) = -Ie log I det(X(r) - zl)| = -1 ^ E log | - z - r^, 
where Ai, . . . , are the eigenvalues of the matrix X. Note that the expected spectral 

(r) 

measure E ^„ is the convolution of the measure E fin and the uniform distribution on the 
disc of radius r (see Lemma 16.41 in the Appendix for details) . 

(r) 

Lemma 1.1. Assume that the sequence E fin converges weakly to a measure ji as n ^ oo 
and r — > 0. Then 

11 = lim E/x„. (1.4) 

n— >oo 
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Proof. Let J be a random variable which is uniformly distributed on the set {1, . . . ,n} 

(r) 

and independent of the matrix X. We may represent the measure E/i„ as distribution of 
a random variable Aj + where Xj and are independent. Computing the characteristic 
function of this measure and passing first to the limit with respect to n — > oo and then 
with respect to r — > (see also Lemma in the Appendix), we conclude the result. □ 

(r) 

Now we may fix r > and consider the measures E . They have bounded densities. 
Assume that the measures E /i„ have supports in a fixed compact set and that E ^„ 
converges weakly to a measure /x. Applying Theorem 6.9 (Lower Envelope Theorem) 
from [16], p. 73 (see also Subsection 16.11 in the Appendix), we obtain that under these 
assumptions 

liminfC/W(^) = (1.5) 

n— ♦oo 

for quasi-everywhere in C (for the definition of quasi- everywhere'^ see for example |16j . p 
24 and Subsection 16.11 in the Appendix). Here U^^\z) denotes the logarithmic potential 
of measure /x^^^ which is the convolution of a measure ^ and of the uniform distribution 
on the disc of radius r. Furthermore, note that U^^\z) may be represented as 

(zo) = ^ / vL{fi;zo,v)dv, 



' JO 

where 

L{fi;zo,v) = ^f U^''Hzo + vexp{i6})d9. (1.6) 

Applying Theorem 1.2 in [TB], p. 84, (Theorem 16.21 in Subsection 16 . 1 1 in the Appendix) we 
get 

limC/M(z) = f/^(z). 

r— >U 

Let si(X) > . . . > Sn(X.) denote the singular values of the matrix X. 

Since ETr (XX*) = 1 the sequence of measures E /i„ is weakly relatively compact. 
These results imply that for any rj > we may restrict the measures E /i„ to some 
compact set Kn such that sup^^E Hn{K^^^) < rj. Moreover, Lemma [6.21 implies the ex- 
istence of a compact K such that lim^^oo sup„ E/i„(K('^))=0. If we take some subse- 
quence of the sequence of restricted measures E /i„ which converges to some measure /i, 
then limmfn^ooUj^] (z) = U^^\z), r > and liuir^o ul{\z) = U^{z). If we prove that 

lim inf „_^oo f^/i^'' (-2) exists and U^{z) is equal to the logarithmic potential corresponding 
the uniform distribution on the unit disc then the sequence of measures E /i„ weakly con- 
verges to the uniform distribution on the unit disc. Moreover, it is enough to prove that 
for some sequence r = r(n) — > 0, lim^^oo uj{]{z) = U^{z). 

Furthermore, let s^\z,r) > ... > Sn\z,r) denote the singular values of matrix 
^^^\z,r) = X(''''(r) — zl. We shall investigate the logarithmic potential ul{^{z). Us- 
ing elementary properties of singular values (see for instance Lemma 3.3 [8], p. 35), we 
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may represent the function U]^J^{z) as follows 

U\:}{z) = — J^E log4^)(z,r) = -- / logx z.(f)(dx,z,r), 

where Vn\-, z, r) denotes the expected spectral measure of the matrix 'H.n^z, r) = (X('^)(r) — 
zI)(X^'^-' (r)— zl)*, which is the expectation of the counting measure of the set of eigenvalues 
of the matrix 'H.n\z, r)). 

In Section [2] we investigate convergence of measure Vn\-,z) = z,Q). In Section 

[3] we study the properties of the limit measures v{-,z). But the crucial problem for the 
proof of the circular law is the so called "regularization of potential" problem. We solve 
this problem using bounds for the minimal singular values of matrices X(^)(z) := X^^^ — z\ 
based on techniques developed in Rudelson [20] and Rudelson and Vershynin [21]. These 
bounds are given in Section H] and in the Appendix, Subsection 11.21 In Section [5] we give 
the proof of the main Theorem. In the Appendix we combine precise statements of relevant 
results from potential theory and some auxiliary inequalities for the resolvent matrices. 

In the what follows we shall denote by C and c or a, /3, 6^ p, rj (without indexes) some 
general absolute constant which may be change from line to line. To specify a constant we 
shall use subindexes. By Ia we shall denote the indicator of an event A. For any matrix 
G we denote the Frobenius norm by ||G|2 and we denote by ||G|| the operator norm. 

Acknowledgment. The authors would like to thank Terence Tao for drawing our 
attention to a gap in a first version of the paper. The authors would like to thank Dmitry 
Timushev for careful reading of the manuscript. 

(e) 

2 Convergence of z/n (•, z) 

Denote by Fn\x, z) the distribution function of the measure i'n\-, z), 

1 " 
i=i 

where s^'^ (z) > ... > Sn '^ (z) > denote the singular values of the matrix X^^^ (z) = 
X(^) — zl. For a positive random variable ^ and a Rademacher random variable (r. v.) 
K consider the transformed r. v. ^ = If ^ has distribution function Fn\x,z) the 

variable C has distribution function Fn\x,z), given by 

Fjf\x,z) = ^(1 + sgn{x}F(^)(x2,z)) 

for all real x. Note that this induces a one-to-one corresponds between the respective 
measures Un\-,z) and ljn\-,z). The limit distribution function of Fn\x,z) as re — > oo , 
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is denoted by F{-, z). The corresponding symmetrization F{x, z) is the hmit of 
as n ^ oo. We have 



sup 



\F^'Hx, z) - F{x, z)\ = 2 sup \Fi'\x, z) - F{x, z)\. 



Denote by Sn\a,z) (resp. s{a,z)) and Sn\x,z) (resp. S{x,z)) the Stieltjes trans- 
forms of the measures z) (resp. u{-,z)) and lyn\-,z) (resp. u{-,z)) correspondingly. 
Then we have 

S^\a, z) = as^j^^a^ , z) , S{a,z) = as{a'^ , z). 

Remark 2.1. As is shown in Bai [1], the measure z) has a density p{x, z) with bounded 
support. More precisely, p{x,z) < Cmax{l, -^}- Thus the measure i^{-,z) has bounded 

support and bounded density p{x, z) = z). 

Theorem 2.2. Let 'EiXj^ = 0, E|Xjfcp = 1. Assume for some function ^p{x) > such 
that ^p{x) — > oo as x —> oo and such that the function x/ip{x) is non- decreasing we have 

K := max 'Ei\XjiJ\^ip{Xj].) < co. (2.1) 

l<j;',fc<oo 

Then 

sviv\Fi'\x,z)-F{x,z)\ <Ck{^{^,))--^. (2.2) 

X 

Corollary 2.1. Let EXjfc = 0, ^\Xjk? = 1, and 

K= max E|Xjfc|^<oo. (2.3) 

l<j,fc<oo 

Then 

sup|F^^)(a;,z) - F(x,z)| <C{npnY^- (2.4) 

X 

Proof. To bound the distance between the distribution functions Fn\x, z) and F{x, z) we 
investigate the distance between their the Stieltjes transforms. Introduce the Hermitian 
2n X 2n matrix 

On (X(^)-Zl)\ 

(X(^)-zI)* Oj' 



w 



where denotes n x n matrix with zero entries. From Sur's complement formula (see 
for example [12j . Ch. 08, p. 21) it follows that, for a = u + iv, v > 0, 



(W-al 



2n) 



' a(x(^)(z)(X(^)(z))* -q2i) 
^((X(^)(z))*X(^)(z) -a^l)"^ 



X(^)(z) (x(^)(z)(X(^)(z))* - 
;x(^)(z))* a((X(^)(z))*X(^)(z) 



a' 



=1) 7 

(2.5) 
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where ^^'^\z) = X^^-* — zl and l2n denotes the unit matrix of order 2n. By definition of 
Sn\a,z), we have 

Si'\a,z) = ^ETT{W-ahn)-^. 
In 

Set R(q, z) := {Rj j^{a, z))Y\.^i = (W — Ql2n)~^. It is easy to check that 

l + aSl^\a,z) = ^ETVWR(a,z). 
We may rewrite this equahty as 

1 " — 

1 + aS^j^\a, z) = - — —= ^ E {ejkXjkRk+n,j{a, z) + EjkX jkRj+n.k{a, z)) 

_ n n 

^.,.+n(a, ^) - ^ E E Rj^nAa, z). (2.6) 
i=i i=i 

We introduce the notations 

A = (X(^)(z)(X(^)(z))* - a^I)-!, B = X(^)(z)A, 
C = ((X(^)(z))*X(^)(z) - a^I)-!, D = C(X(^)(z))*. 

With these notations we rewrite equahty ()2.5p as fohows 

R(a, z) = (W - = ^ . (2.7) 

Equahties (12. 7p and (12. 6p together imply 

1 " — 
1 + a5'<f)(a, z) = - — —= ^ E (ejkXjkRk+njia, z) + ejkXjkRj.k+n{a, z)) 

- — ETrD - — ETrB. (2.8) 

2n 2n ^ ' 

In the what follows we shall use a simple resolvent equality. For two matrices U and 
V let Rc/ = (U - aI)-\ B^u+v = (U + V - aI)-\ then 

= Rl/ — R(7VR(7+y. 

Let {ei,...e2„} denote the canonical orthonormal basis in M^". Let W^-''^^ denote the 
matrix is obtained from W by replacing the both entries Xj^^ and Xj^k by 0. In our 
notation we may write 

W = W^^''^) + -^=ejkXjkejel^^ + — ^ejfcXjfeefe+„e[. (2.9) 
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Using this representation and the resolvent equahty, we get 

R = R(i,fc) _ x,-fcR(^>)e,e^+„R - .fcX,-fcR(^>)efc+„ejR. (2.10) 

Here and in the what follows we omit the arguments a and z in the notation of resolvent 
matrices. For any vector a, let a-^ denote the transposed vector a. Applying the resolvent 
equality again, we obtain 

R = R(i,fc) _ x,fcR(^»e,e^^.„R(^» - .,X,fcR(^''=)efe+„ejR(j''=) + T^^''^), 

(2.11) 



where 



+ -^e,-fcX,-fcR(^-'^-)e,e^+jR(^» - R) 

+ -^e,-fc(X,fc)R(^»efc+„eJ(R(^» - R) 

+ -^e,-fcX,fcR(^'^-)efc+„eJ(R(^''=) - R). (2.12) 



This implies 



~ -^fc+nj ^yj^^jk^jk^k+n,j^j,k+n ^J7j:j^^3^^ j^'^k+n,k+n'^j,j ~^ ^ k+n,j- 

(2.13) 

Applying these notations to the equality (|2.8p and taking into account that and R'^-^'^^ 
are independent, we get 

_ . n 



j,fc=i 
1 " 

j.k=\ 



1 " 



(2.14) 
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From (|2.10p it follows immediately that for any p,q = 1, • • • , 2n, j,k = 1, . . . n, 



\Rp,p - RpP\ < -^^=^i\Rp^j\\Rk+n,p\ + l^p*L+nll-^Jpl)- 



(2.15) 



Since Emj=i \Rm,i? < n/v"^ and Em,«=i l^m/ < equality (I233D implies 

„2 - „„4- 



(2.16) 



j,k=i 



By definition ()2.12|) of T'--'''^'', applying standard resolvent properties, we obtain the fol- 
lowing bounds, for any z = u + iv, v > 0, 



Bejk\Xjk\\T.^^^J < 



j,k=i 



(2.17) 



For the proof of this inequality see Lemma [6. 3 1 in the Appendix. Using the last inequalities 
we obtain, that for v > 



- E Rjj - Rk+n,k+n -^YH^ ^ ^k+n 



k+n 



k=l 



< 



j=l k=l 

c 



< 



„2 E I Xjk I ( I R-j 1 1 Rk+n,j I + I Rlk+n 1 1 ^. 

V ^ j=i k=i 

c 



nv 



(2.18) 



Since ^ YJj=i Rjj = ^ ELi Rk+n,k+n = ^TrR(a, z), we obtain 



^ n n ^ 



EEE<^i?ErU.-E(^T^R(a,.)) 



j=i k=i 



< 



(2.19) 



Note that for any Hermitian random matrix W with independent entries on and above 
the diagonal we have 



E 



-TrR(a, z)-B -TrR(a, z] 
n n 



< 



C 



(2.20) 



The proof of this inequality is easy and due to a martingale type expansion already used 
by Girko. Inequalities (|2.19p and (|2.20p together imply that for > 



^ n n 



j=i k=i 



< 



c 



(2.21) 
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Denote by r{a,z) some generic function with |r(a, z)| < 1 not necessary the same from 
line to hne. We may now rewrite equahty (j2.8p as follows 

1 + aSi'\a,z) + iSi'\a,z)f = -;^ETrD - ^^ETrB + /l"'^, . (2.22) 

where v > Cip{yjnpn) /n. 

We now investigate the functions T{a,z) = ;iETrB and V{a,z) = ^ED. Since the 
arguments for both functions are similar we provide it for the first one only. By definition 
of the matrix B, we have 

1 

TrB = —= Yl e,kX,,k{^'''\z){x'-'\z)r - a^)-^)u, - zTiA. 
According to equality (j2.7p . we have 

E^ikXjkRki — zTyA. 

Using the resolvent equality ()2.10p and Lemma [6^ we get, for v > cip{y/npn) /n 

= - A E Ei?K^Xf - -SL'Ha,z) + (2.23) 

Similar to (I2.2ip we obtain 

l-i Y BB^^B^^^ - Via,z)Si^\a,z)\ < (2.24) 
j,k=i 

Inequalities (|2.23p and (j2.24p together imply, for v > cip{^npn)/n, 

rr, X zS^Hp^) Cxrja^z) 

T[a,z) = 1 ■ . (2.25) 

a + Sn {a,z) tp{^npn)v^a + Sn {a, z)\ 



I " 
TrB = ' 

aJnpn 



Analogously we get 



zS^n\a,z) , ^ C 



V{a,z) = u) + ^ U) :■ (2-26) 

a + Sn'{a,z) ip{^npn)v'^\oL + Sn' {a, z)' 

Inserting ([2:25]) and ([2:26]) in ([2Ti]) . we get 

1 2 Q{f:)i 



{S^\a,z)f + aSi^\a,z) + 1 - = 5„(^), 

a + S*™ (a, z) 



(2.27) 
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where ^ 

\6n{a,z)\ < r-: . 

^{\/n'Pn)v^\Sn {a, z) + a.\ 

or equivalently 

Si")(Q,z) (a + Si")(a,z))\ (a + 5„((")a,z)) - \z\'^ S^^\a, z) =^n{a, z), (2.28) 
where 5n(a, z) = 6-^^=^^ . We may rewrite the last equation as 

S^\a,z) = " + + Uc^,z), (2.29) 

(a + 5i')(a,z))2-|z|2 

where _ 

()n(a,2:) = ■ (2.30) 

{a + S^^\a,z)Y -\z\^ 

Furthermore, we prove the following simple Lemma. 
Lemma 2.2. Let a = u + iv, f > 0. Let S{a, z) satisfy the equation 

^("'"^ = - (a + 5(a,.))2-|.p - (2.31) 
and Im{S'(a,z)} > 0. Then the following inequality 

l-\b[a,z)\ -- — — — --^ > 



\a + S{a, z)\'^ V + 1 
holds. 



Proof. For a = u + iv with u > 0, the Stieltjes transform S{a, z) satisfies the following 
equation 

a + ^(a, z) 
(a + ^(a, z))2 — \z\ 
Comparing the imaginary parts of both sides of this equation, we get 



5(a, z) = , J/r;;^ , (2.32) 



Im{a + 5(a, z)} = Im{a + S(a, z)} l« + ^("^ + I^P + (2.33) 

Equations (|2.3ip and (|2.33p together imply 

T r o/ M Z^-, |a + ^(a,^)^ + |z|2 \ 

Since u > and Im{a + S{a, z)} > 0, it follows that 

_ \a + S{a,z)\'^ + |z|2 
|(a + 5(a,z))2 - |z|2|2 > 
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In particular we have 

\S{a,z)\<l. 

Inequality (j2.34p and the last remark together imply 

^ la + S(a, z)p + |zp V > ^ 



\{a + S{a,z))^ - |z|2|2 lm{a + S{a,z)} " v + 1 
The proof is completed. □ 

To compare the functions S{a,z) and Sn{a,z) we prove 
Lemma 2.3. Let 



Then the following inequality holds 



K{a,z)\ < |. 



^ _ \a + S^n \a, z)\'^ + \z\^ ^ V 
\ia + si'\a,zW-\z\^\^ ~ 4' 
Proof. By the assumption, we have 

^ V 
Im{5„(a,2:) +a} > -. 

Repeating the arguments of Lemma 12.21 completes the proof. □ 

The next Lemma give us a bound for the distance between the Stieltjes transforms 
S{a,z) and Sn\a,z). 

Lemma 2.4. Let 

\Snia,z)\ < -. 

Then ^ 

4\6n{a,z)\ 



\Si'\a,z)-S{a,z)\ < 



V 

Proof. Note that S{a,z) and Sn\a,z) satisfy the equations 
and 

Si'Ha, z) = - "tf"^^":'\ ,^ + 5n(a, z) (2.36) 
(a + ^(a, zY - \z\^ 

respectively. These equations together imply 

(a + S''n\a, z)){a + S{a, z)) + \z\'^ 



S{a, z) — S^\a, z) 



((a + 5(q, z)2 - |z|2)((a + 5i')(a, zf - |z|2) 

x(5(a,z) - Si")(a,z)) z). (2.37) 
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Applying inequality \ab\ < ^{a^ + 6^), we get 



(a + Sn\a, z)){a + S{a, z)) + \z\ 



{{a + S{a, zY - |z|2)((a + S^^\a, zY - \z\^) 

|a + 5'n(a,^)P + |zp ^ 
\{a + sl^\a,z)Y-\z\^\^j 
\a + S{a,z)\'^ + |zp 



\{a + S{a,z)f 



1212 



The last inequality and Lemmas 12.21 and 12.31 together imply 

{a + sl^\a,z)){a + S{a,z)) + \z\'^ 



1 



((a + S{a, zf - |z|2)((a + dt\a, zf - \z\^) 
This completes the proof of the Lemma. 
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□ 



To bound the distance between the distribution function Fn{x, z) and the distribution 
function F{x^ z) corresponding the Stieltjes transforms ^^(a, z) and S{a, z) we use Corol- 
lary 2.3 from [9]. Li the next lemma we give an integral bound for the distance between 
the Stieltjes transforms S{a,z) and Sn\ci,z). 

Lemma 2.5. For v > vo{n) = c{ip{y/np^))~ 6 the inequality 



\S{a,z) - Sl^\a,z)\du < 



C(l + |z|2)x 



holds. 

Proof. Note that 

|(a + s(f (a, - l^l^l > \a + sl^{a,z) -\z\)\\a + s'i^{a,z) + \z\)\\ > z;^. 



(2.38) 



It follows from here that |(5„(a, 2;)| < 



c 



and 



\Sn{a,z)\ < v/8 

for V > c{ip(y/npn))~^^^ ■ Lemma 12.41 implies that it is enough to prove inequality 

/oo ^ 
\6n{a,z)\du < C-fn, 
'OO 

where 7„ = ^a^^^^—- y . By definition of 6{a, z), we have 



|(5„(a, z)\du < 



du 



^V(V^) 7-00 \{a + S^'\a, z)Y - \z\ 



(2.39) 
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Furthermore, the representation (|2.29p imphes that 



1 ^ \s!i\a,z)\ ^ '\6n{a,z)\ 



Note that, according to the relation (j2.27p . 

1 < ,2.41) 



|a + s!f'(o,z)| |o + si''{a,2)|2 " ' |a + si''(a,z)P 
This inequahty imphes 

(2.42) 

It follows from the relation (|2.27|) . for v > c{(p{y/np^))~a , that 

Cx 

Ma, z)\ < , < 1/2. (2.43) 

The last two inequalities together imply that for sufficiently large n and v > c{(p{y/np^))~6 , 



|a + Sjf'(a,i)| i-oo " ' 

The inequalities (|2.4ip . (|2.39p . and the definition of 5n{a,z) together imply 

\Ua,z)\dn< ^}\'^}^ + ^ f"" r \U»,z)\du. (2.45) 



If we choose v such that a 9^ a < i we obtain 



C(l + |zp 



|<5„(a,z)|dn< -f^^J-^. (2.46) 



□ 



In Section [3] we show that the measure i^{-,z) has bounded support and bounded 
density for any z. To bound the distance between the distribution functions Fn\x, z) and 
F{x,z) we may apply Corollary 3.2 from [9] (see also Lemma 16.61 in the Appendix). We 
take V = 1 and vq = C{(p{^npn))^~> ■ Then Lemmas 12.21 and 12.31 together imply 

sup\Fi'\x,z)-F{x,z)\<C{^{^))-l (2.47) 

X 

□ 
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3 Properties of the measure i^{-,z) 

In this Section we investigate the properties of the measure ;/(•, z). At first note that there 
exists a solution S{a, z) of the equation 

Q( N S{a,z) + a 

b{a,z) = --— 7 -75 j— (3.1) 

^ ' {S{a,z) + a)2 - |z|2 ^ ^ 

such that, for v > 0, 

lm{S{a,z)} > 

and S{a, z) is an analytic function in the upper half-plane a = u + iv, v > This follows 
from the relative compactness of the sequence of analytic functions S'n(a, -z), n G N. From 
(|2.35|) it follows immediately that 

\S{a,z)\<l. (3.2) 
Set y = S{x, z) + X and consider the equation (j2.35p on the real line 

y = 2 ^1 12 (^•'^) 

y ~ \A 

or 

?/3-a;y2 + (i_ |z|2)y + x|zp = 0. (3.4) 

Set 

2 _ 5 + 2|zp (l + 8|zp)i -1 2 _ 5 + 2|zp (l + 8|zp)i +1 



It is straightforward to check that for \z\ < 1 — |zp) < and x| < for \z\ < 1 

and X2 = for \z\ = 1, and > foi' kl > 1- 



Lemma 3.1. In the case \z\ < 1 equation ^3.4\ ) has one real root for \x\ < and 
three real roots for \x\ > \xi\. In the case |z| > 1 equation ( |g.^| ) has one real root for 
\x2\ < \xi\ and has tree real roots for \x\ < \x2\ or for \x\ > \xi\. 

Proof. Set 

L{y) := - xy"^ + (1 - \z\'^)y + 
We consider the roots equation 

L'(y) =32/2-2xy + (l-|z|2) = 0. (3.6) 

The roots of this equation are 



X ± J x'^ — 3(1 — |zp) 
yi,2 = 5 ■ 
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This implies that, for |z| < 1 and for 

\x\ < 



the equation (j3.4p has one real root. Furthermore, direct calculations show that 
L{yi)L{y2) = ^ {-A\z\'x^ + i8\z\^ + 20|zp - l)x' + 4(1 - \z\y) . 
Solving the equation L{yi)L{y2) = with respect to x, we get for \z\ < 1 and 



\/3(l - |z|2) < |x| < |xi| 

L{yi)L{y2) > 0, 



and for \z\ < 1 and \x\ > J + ^i±%g^ 



L(yi)L(y2) < 0, 

These relations imply that for \z\ < 1 the function L{y) has three real roots for \x\ > \xi\ 
and one real root for \x\ < \xi\. 

Consider the case \z\ > 1 now. In this case yi^2 are real for all x and x| > 0. Note that 

L{yi)L{y2) < 

for \x\ < \x2\ and for \x\ > \xi\ and 

L{yi)L(y2) > 

for \x2\ < x < l^il. These implies that for \z\ > 1 and for \x2\ < x < \xi\ the function 
L{y) has one real root and for |x| < \x2\ or for |x| > the function L{y) has three real 
roots. The Lemma is proved. □ 

Remark 3.1. From Lemma [3. II it follows that the measure i'{x, z) has a density p(x, z) and 

• p(x, -z) < 1, for all x and z; 

• for \z\ < 1, if |x| > xi then p{x, z) = 0; 

• for |2;| > 1, if |x| > xi or \x\ < X2 then p{x, z) = 0; 

• p(x, z) > otherwise. 

The next lemma is an analogue of Lemma 4.4 in Bai [I]. 
Lemma 3.2. The following equality 

^ log xu{dx, z)j = i5?{5(x, z)} (3.7) 

holds. 
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Proof. Following Bai [T] Lemma 4.4, we consider 

'''^ dy{x) 



I{C) := [ 
Jo 



ds 



dx. (3.8) 



We have 

+ 2xy'^ + x'^y-\z\'^y + y + x = Q. (3.9) 
Taking the derivatives with respect to x and s correspondingly, we get 

1^ (32/2 + 4x2/ + (1 - \z? + x^)) = -1 - 2y{x + y) (3.10) 



and 

|j (32/2 + Axy + (1 - + x^)) = 2sy. (3.11) 
These equalities together imply 

dy 2sy dy 



ds l + 2y{x + y)dx' 
Prom equation (j3.9p it follows that 



(3.12) 



1 + 22/(2/ + x) = ±Vr+4|^|V- (3.13) 
Using the results of Remark 13. H it is straightforward to check that for |z| < 1 



1 + 22/(2/ + re) = VI + 4|z| 22/2 (3.14) 



and for |2;| > 1 there exists a number xq such that y^l + 4|zp2/^ = 0. Furthermore, we 
have for — xq < x < 

1 + 22/(2/ + x) = Vl + 4kp2/2 (3.15) 

and for x < — xq we obtain 



1 + 22/(2/ + x) = -Vr+4|I|V. (3.16) 
Using these equalities, we get 

r = - r '^4.. (3.17) 

For \z\ < 1, we have 

/I - - L TmW^Tx'^ ^ W ^ '^'^'''^-'^ Wl + 4N2(|.|2 _ 1) 

(3.18) 
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In the limit C — > oo, we get, for \z\ < 1, 



°|..= £. (3.1.) 



For \z\ > 1, we have 



° . r ^^^^^ - r ^.^^^^ - (3.20) 



Similar to Bai [T] (equality (4.39)) we have 



rO rC /-oo 



y{x)dx = I y{x)dx = I I v(du,z)dx 

c J-C Jo Jo u + x 



poo 

InC + [ln(n + C) - In u] v{du, z) 
Jo 

lnC+ / ln{l + -)u{du, z) - lnuu{du,z). (3.21) 
Jo ^ Jo 



After differentiation we get 

Q roc, d u d 

— J^ lnw{du,z) = —J^ \n{l + -)u{du,z)- j ^—y{x)dx. (3.22) 

Relations (j3l^ - ([3:22]) together imply the result. □ 

4 The smallest singular value 

Let X^*") = -^/== {^jk^jkfj i^^i be an n X n matrix with independent entries Ej^Xji^, j, k = 
1, . . . ,n. Assume that E Xj^ = and E X?^ = 1 and ejk denote Bernoulli random variables 

with pn = Pr{ejfc = 1}, j,k = l,...,n. Denote by s^i\z) > ... > Sn\z) the singular 
values of the matrix X^^^ (z) := X^^) — zl. In this Section we prove a bound for the minimal 
singular value of the matrices X(^)(z). We prove the following result. 

Theorem 4.1. Let Xjk be independent random complex variables with EXj^ = and 
EjXjfcp = 1, which are uniformly integrable , i.e. 

ma^^\Xjk\^I{\x,^\>M}^^ as M ^ 0. (4.1) 

Let £jk, j,k = 1, . . . ,n be independent Bernoulli random variables with pn ■= Prje^fc = 1}. 
Assume that £jk are independent from Xjk in aggregate. Let p^^ = 0{n^^^) for some 
< 6 < 1. Let K > 1. Then there exist constants c,C,B>0 depending on 6 and K such 
that for any 2: G C and positive e we have 

Fr{si'\z) < e/n^; s['\z) < Kn^} < exp{-c:p,n} + (4.2) 
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Remark 4.2. Let Xjk be i.i.d. random variables with EXj^ = and E|Xj7cp = 1. Then 
the condition (j4.ip holds. 

Remark 4.3. Consider the event A that there exists at least one row with zero entries only. 
Its probability is given by 

Pr{^}>l-(l-(l-p„n"- (4.3) 

Simple calculations show that if npn < Inn for all n > 1, then 

Pr{^} > 5 > 0. (4.4) 

Hence in the case npn < Inn and npn — > oo we have no invertibility with positive proba- 
bility 

Remark 4.4. The proof of Theorem 14.11 uses ideas of Rudelson and Vershynin j21j . to 
classify with high probability vectors x in the (n — l)-dimensional unit sphere S^~^ such 
that I jX'^^-' (2;)x| I2 is extremely small into two classes called compressible and incompressible 
vectors. 

We develop our approach for shifted sparse and normalized matrices X(=)(z). The 
generalization to the case of complex sparse and shifted matrices X^^^ (z) is straightforward. 
For details see for example the paper of Gotze and Tikhomirov [10] and proof of the Lemma 
[iT] below. 

Remark 4.5. We can relax the condition p~^ = 0{n^~^) to p~^ = oinj \v? n). The quantity 
B in Theorem 14. II should be of order Inn in this case. See Remark 14. 101 for details. 

Lemma 4.1. Let x = {xi, . . . ,Xn) G S^~^ be a fixed unit vector and X(^)(2:) be a matrix 
as in Theorem \4.1\ Then there exist some positive absolute constants 70 and cq such that 
for any < r < 70 

Pr{||x(^)(z)x||2 < r} < exp{-conp„} V exp{-con}, (4.5) 
where xVy denotes the larger of x and y 

Proof of Lemma \4:.l[ Recall that EXy = and E = 0. Assume first that Xij are 

real independent r.v. with mean zero, and variance at least 1. Let X^j '^ = Xij Sij with 
independent Bernoulli variables which are independent of Xij in aggregate and let z = 0. 
Assume also that x is a real vector. Then 

I |X(^)x| = — E E -'^^.^^.'^ =^ — E C|- (4-6) 



k=l 



By Chebyshev's inequality we have 



n 



P^iE C| < r'np^} = Pr{^ - ^ E ^1 > 0} ^ exp{np„r2tV2} J] E exp{-t\]/2}. 
j=i j=i i=i 

(4.7) 
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Using e = E exp{it^} where ^ is a standard Gaussian random variable, we obtain 



< ^'^nPn} < exp{npnTh^ /2} n ^ n ^ s.-^^.fc expiit^jXkSjkXjk}, (4.8) 
i=i j=i k=l 

where ^j, j = 1, . . . ,n denote i.i.d. standard Gaussian r.v.'s and E z denotes expectation 
with respect to Z conditional on all other r. v.'s. For every a,x £ [0, 1] and p G (0, 1) the 
following inequality holds 



a 



(4.9) 



(see 0], inequality (3.7)). Take a = Pr{|^j| < Ci} for some absolute positive constant Ci 
which will be chosen later. Then it follows from ()4.8p that 



It 



7=1 

n 



Vfc=i 



+ 1 - a 



(4.10) 



Furthermore, we note that 

l^ejkXjk exp{it(,jXkejkXjk}\ < exp{^(|E g^^x^fe exp{it^jXkejkXjk}\'^ - 1)} 

< exp{-p„ ((1 -p„)(l - Refjkitxk^j)) + ^(1 - |/ifc(iXfcCi)P))}, (4.11) 



where fjk{u) = E exp{zMXjfc}. Assuming (j4.ip . choose a constant M > such that 

supE < 1/2. (4.12) 

jk 

Since 1 — cosx > ll/24x^ for |x| < 1, conditioning on the event < Ci, we get for 
< t < l/(MCi) 



1 - KefjkitXkij) = Ex,,(l - cos{tXkXjkij)) > ^t^^Cj^ \^jk\^h\x,,\<M}, (4-13) 
and similarly 

1 - \fjk{txk^j)\^ = Ex,,(l - cositXkXjk^j)) > ^t^xU]E \X,k\^I{\x,,\<M} (4.14) 
It follows from (|4.11j) for < t < l/(MCi) and for some constant c > 

exp{itCjXkejkXjk}\ < exp{-cpnt^xl^j}. (4.15) 
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This implies that conditionally on < Ci and for < t < l/(MCi) 

n 

I JJ Ee^.^Xj^ ex];){it(,jXkejkXjk}\ < exp{-cp„t^^|}. 



(4.16) 



k=l 



Let ^o{x) := 2$(x) — 1, x > where denotes the standard Gaussian distribution 
function. It is straightforward to show that 



E^^ {exp{-cpnt^^]} < C 



v/1 + 2ct2p„ $o(Ci 



(4.17) 



Applying Taylor's formula, we obtain 



$0 fCiVl + 2ctV«) / ^ 

^ ^ ^ = 1 + I a/T 

^o(Ci) 



+ K/l + 2t2cp„ - 1 



$'o(^Ci(l + Vl + 2ct2p„ 
$o(Ci) 



(4.18) 



Using that for < y < 8 we have y/4 > y/TTy- 1 < y/2 and {Ci{l + y^l + 2t'^pnCj < 
<^>o{Ci), we get 



$0 CiVl + 2ctV 



< 1 + ctV- ° 



$o(Ci) - ""$o(Ci)- 

We may choose Ci large enough such that following inequalities hold 

< exp{-ctV/24} 



(4.19) 



(4.20) 



for all |t| < l/(MCi) < 8. Inequalities (US]), (iS]), (HTTI) . (11:2(1]) together imply that for 
any (3 G (0, 1) 



I^Cj < r^npn} < exp{np„r2t2/2}(exp{-c/3ntV/24} + f ^ 



n0 

/3\ W3 



(4.21) 



Without loss of generality we may take Ci sufficiently large, such that a > 4/5 and choose 
P = 2/5. Then we obtain 



Pr{^C| < T^npn} < exp{npnThy2}(^exp{-ct\pn/60} + 
i=i 



2n 

1\~ 



(4.22) 
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For r < we conclude from here that for It I < l/fMCi) 

V60 ' ' 



< T^Pn} < exp{-ct^npn/120}. 



(4.23) 



Inequahty (j4.23p imphes that inequahty (|4.5p holds with some positive constant cq > 0. 
This concludes the proof in the real case. 

Consider now the general case. Let Xji^ = ^j/; + irjjf^ with i = with E l^jfcp = 1 
and Xfc = lifc + ivk and z = u + iv. In this notation we have 



Pr{||(X(^) -zl)x||2 <t} 

r r n 

< exp{T^np„t^/2} min < E exp < -t^ ^ 



E exp <j -t2 ^ 



fc=i 



fc=i 



/2^ 

/2 
(4.24) 



Note that for x = (xi, . . . ,Xn) G S^"' (the unit sphere in C") and for any set A C 
{!,... ,n} 

max{^ ^ > 1/2. (4.25) 

For any j = 1, . . . , n we introduce the set Aj as follows 

Aj:={k£{l,...,n}: E\CjkUk - ^jkykl"^ > {xklV^}- (4-26) 
It is straightforward to check that for any k ^ Aj 

E \vjkUk + Cifc^^fcP > \xk\'^/2. (4.27) 

According to inequality (|4.25p . for any j = 1, . . . , n, there exist a set such that 

\xk\^ > 1/2 (4.28) 



fcS-B, 



and for any k € 



E \CjkUk - 'HjkVkl'^ > \xk\'^/2, 



or 



^\r]jkUk + CjkVkf > \xk\'^/2. 
Introduce the following random variables for any j,k = 1, . . . , n 

Cjk ■= ijkUk — VjkVk, 



(4.29) 
(4.30) 

(4.31) 
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and 

Cjk ■= rijkUk + ijkVk- (4.32) 
The inequalities (j4.29p and (j4.30p together imply that one of the following two inequalities 

card |j : for any k e Bj E |Cjfc|^ > kfc] > n/2 (4.33) 

or ^ 

card |j : for any k ^ Bj E |Cjfc|^ > kfc| V2} > n/2 (4.34) 

holds. If (j4.33p holds we shall bound the first term on the right hand side of (j4.24p . In the 
other case we shall bound the second term. In what follows we may repeat the arguments 
leading to inequalities (|4.10p - (j4.16p . Thus the Lemma is proved. □ 

For any G (0, 1) and iiT > to be chosen later we define Kn ■= Kn^/p^, qn : = 
Qn/ [ln{2/pn)lnKn) and pn ■= Pn/( ln(2/p„) lni^„) . Without loss of generality we shall 
assume that 

lnJf„/|ln7o| > 1 and InKn > 1. (4.35) 

Proposition 4.6. Assume there exist an absolute constant c > and values 7„, qn G (0, 1) 
such that for any x G C C 5^"^^^ 

Pr{||x(^)(z)x||2 < 7n and ||x(^)(z)|| < K^} < exp{-cng„} (4.36) 

holds. Then there exists a constant 60 > depending on K and c only such that, for 
k < 6onqn, 

Pr{ inf ||X(^)(z)x||2 < 7„/2 and ||X(^)(z)|| < Kn} < exp{-cng„/8}. 

Proof. Let r/ > to be chosen later. There exists an r/-net Af in S^~^ n C of cardinality 
< (|)^^ (see e.g. Lemma 3.4 in [20]). By condition (|4.36p . we have for r < 7„ 

Pr{ there exists x € : ||X(^)(z)x||2 < r and ||X(^)(z)|| < Kn} < (-)^'' exp{-cn 

V 

(4.37) 

Let V be the event that ||X(^)(2;)|| < Kn and ||X(^)(z)y||2 < |r for some point y G 
^(f^-^) Pi Assume that V occurs and choose a point x £ J\f such that ||y — x||2 < ?/. 
Then 

||X(^)(z)x||2 < ||X(^)(z)y||2 + ||X(^)(z)||||x-y||2 < + KnT] = t (4.38) 
if we set = r/ (2Ar„). Hence, 

. s / /3\2<5o/(ln-ft'„ln{2/p„)) , Cn ^ \ "9" , , 

Pr(y)<((-) e^Pi-f}) • (4-39) 

Note that under assumption ()4.35p we have 

21n(3/r/) 



ln21nA:„ 



< 10. (4.40) 



Choosing Sq = and r = 7„, we conclude the proof. □ 
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Following Rudelson and Vershynin [21], we shall partition the unit sphere into 
the two sets of socalled compressible and incompressible vectors and we will show the 
invertibility of X on each set separately. 

Definition 4.7. Let 6,p £ (0, 1). A vector x € is called Sparse if |supp(x)| < Sn. A 
vector X G S^"^'^^ is called compressible if x is within Euclidean distance p from the set of 
all sparse vectors. A vector x G cS^""^-* is called incompressible if it is not compressible. 

The sets of sparse, compressible and incompressible vectors depending on 6 and p will 
be denoted by 

Sparse{6), Comp{d,p), Incomp{6,p), (4-41) 

respectively. 

Lemma 4.2. Let X^^-'(z) be a random matrix as in Theorem and let Kn = Kuy/p^ 
with a constant K >1. Assume there exist an absolute constant c > and values 7n,<?n £ 
(0, 1) such that for any x G C C 

Pr{||x(^)(z)x||2 < 7n and ||x(^)(z)|| < Kn} < exp{-cng„} (4.42) 

holds. Then there exist 6i,ci that depend on K and c only , such that 

Pr I inf^ ||X(^)(z)x||2 < 7n and ||X(^)(z)|| < Kn] < exp{-ci nqn}, (4.43) 

)nc J 

where pn := 7rt/(4/i:„). 

Proof. At first we estimate the invertibility for sparse vectors. Let k = [5inqn] with some 
positive constant 6i which will be chosen later. According to Proposition 14.61 for any 
Si < 6q and for any r < 7n/2, we have the following inequality 

Prj inf ^ ||X(^)(2;)x||2 < r and ||X(^)(z)|| < if„l 

= Pr i there exist a, IctI = A; : inf ||X(^)(z)x||2 < r and ||X(^)(z)|| < Kn\ 
{ xeiR-nc,||x||2=i J 

< exp{-conqn/8}. 
Using Stirling's formula, we get for some absolute positive constant C 

\ In Q < -Chqn ln(5g„). (4.44) 
We may choose b\ small enough that 

\ In j < co(Z„/16. (4.45) 
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Thus we get 



Pr I inf ^ ||X(^)(z)x||2 < r and ||X(^)(z)|| < kA < exp{-cing„}. (4.46) 

\^x£Sparse{Si pn)r\C J 

Choose p := 7 := 7.„/4. Let V be the event that ||X(^)(z)|| < Kn and ||X(=)(2)y||2 < 71 
for some point y € Comp(6iPn, pK~^). Assume that V occurs and choose a point x G 
Sparse{5iPn) such that ||y — x||2 < pK~^. Then 

||x(^)(2)x||2 < ||x(^)(z)y||2 + ||x(^)(z)||||x-y||2 <7i + P = 7n/2. (4.47) 



Hence, 



Vt{V) < exp{-— nqn}. (4.48) 



Thus the Lemma is proved. □ 

Lemma 4.3. Let 5,p £ (0,1). Let x G Incomp{6, p). Then there exists a set o"(x) C 
{1, . . . ,n} of cardinality |o'(x)| > ^n6 such that 

fc6o-(x) 

and ^ 

^ ^ \xk\ < — , for any k G o"(x) (4.50) 



V2n ^nbl2' 
which we shall call "spread set of x" henceforth. 



Proof. See proof in [21], p. 16, proof of Lemma 3.4. For the readers convenience we repeat 
this proof here. Consider the subsets of {1, . . . , n} defined by 

C7i(x) := {k : \xk\ < ^i=}, f^2(x) = {k : \xk\ > -^}, (4.51) 
y'dn/2 V2n 

and put cr(x) = o"i(x) n cr2(x). Denote by -Po-(x) the orthogonal projection onto M"^^^ in 
W^. By Chebyshev's inequahty |(Ti(x)'^| < 6n/2. Then y := P^^(^^-^cX G Sparse{5), so the 
incompressibihty of x imphes that ||Po-^(x)x||2 = ||x — y||2 > p. By the definition of (72(x), 

°<T2(x)<=x|p < 



we have ||Pcr2(x)<:x|P ^ = Hence 



ll^a(x)x||i > ||P.,(x)x||l - ||P.,(x)x||l > pV2. (4.52) 
Thus the Lemma is proved. □ 

Remark 4.8. If x G Incomp{6pn, p) then there exists a set ct(x) with cardinahty |cr(x)| > 
^n6pn such that 

^ < \xk\ < \ (4.53) 



\/2n y^n5pn/2 
and 

ll^<x{x)x||i > (4.54) 
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Let Q{r]) = sup^^. sup^g^ Pr{|Xjfc — u\ < r/}. Introduce the maximal concentration 
function of the weighed sums of the rows of the matrix 

n 

p^it]) = max supPr{| V'XjfcejfcXfc - n| < T?}. (4.55) 

ie{l,...,n}„gc ^ 

We shah now bound this concentration function and prove a tensorization lemma for 
incompressible vectors. 

Lemma 4.4. Let 5n and pn be some functions of n such that Pm^n £ (0, 1). Let r/o and 
tq CIS in LemmcL 6.7 Let x G LncoTnp(^Snj Pn). Then there exists positive constants ri and 
r2 depending on rg such that for any < t] < rjo we have 



pAvPn/ V 2n) < 1 - r25n npn (4.56) 

for n5nPn < 1/3 and 

p^{r]Pn/V^) < 1 - ri < 1 (4.57) 

for nSnPn > 1/3. 

Proof. Put m = ndn- We have 

m m 

su-gVv{\^^Xjk£jkXk -u\< i^pnl^Phi) < Fri^Ejk = 0} 
" k=i k=i 

m m 
+ Pr{| ^XjfcffjfcXfc -u\< riPn/V2n; ^£jk > !}• 

k=l k=l 

(4.58) 



Introduce (t(x) := {A; G {1, . . . , n} : p^j \phi < \xk\ < l/^/m/2}. Since x G Incomp{dn, Pn) 
the cardinality of (t(x) is at least m/2. Using that the concentration function of sum of 
independent random variables is less then concentration function of its summands, we 
obtain 

m 

supPi{\y2Xjk£jkXk-u\ <VPn/V2^} < (1-p„)- + Q(7^)(1-(1-p„)-). (4.59) 
k=i 

According to Lemma [6.71 in the Appendix for any rj < r]Q, we have Q(??) < ?'o < 1- Assume 
that mpn > 1/3. Then we have 

■m 

supPr{| VXjfcejfcXfc - n| < ?yp„/^} < ro + (1 - ro)e-"'P" 
k=i 

< 1 - (1 - e-^/3)(l - ro) =: 1 - ri < 1. (4.60) 
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If mpn < 1/3 then (1 — Pn)™ < 1 — rnpn/'i and 

m 

supPr{| Y^XjfcejfcXfc -u\ < r]pn/V2n} < 1 - (1 - ro)mp„/3 =: 1 - r2mp„. (4.61) 
fc=i 

The Lemma is proved. □ 

Now we state a tensorization lemma. 

Lemma 4.5. Let Ci, - ■ ■ ,Cn be independent non-negative random variables. Assume that 

Pr{Ci < A„} < 1 - g„ (4.62) 

for some positive Qn G (0, 1) and Xn > 0. Then there exists positive absolute constants K\ 
and K2 such that 

n 

Pr{ C| < KfnqnXl} < exp{-K2nqn}. (4.63) 
i=i 

Proof. We repeat the proof of Lemma 4.4 in [13]. Let t = Ki^Jq^^Xn. For any r > we 
have 

n n 

Pr{^ C| < nt^] < e"" JJ E exp{-rC|/t^}. (4.64) 

Furthermore, 



E exp{-rC|A^} = / Pr{exp{-rC|/t^} > s}ds 
Jo 

= Pr {l/s > expirCj /t"^}} ds 
Jo 



/■cxp{-rA2/t2} .1 

< / ds+ / (l-g„)c?s 

JO Jcxp{-TA2/t2} 

< 1 - (?„(1 - exp{-TXl/t^}) = 1 - g„(l - exp{-T/iKfqn)}). (4.65) 
Choosing r := (?n/4 and := 41^, we get 

n 

Pr{^ C| < f^i^} < exp{-n,?„/2}. (4.66) 

Thus the Lemma is proved. □ 

Recall that we assumed p~^ = 0{n^~^),l > > 0. For this fixed consider 
L := [^]. Hence by definition p^^i ■= {npnY Pn — > 0, n — > co for I = 1, ... ,L — 1 and 
\im sup^^^{npn)^ Pn > 0. We put Pn,L ■= 1- 

We shall assume that n is large enough such that {npn)^Pn > Qi > for some constant 
Qi > 0. Starting with a decomposition of Co := 5'-""^-' into compressible vectors x in 
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Ci := Co n Comp{6iPn,i,Pn,i), where Pn,i = Pn, Pn,i = 7o/(4i^n), and the constants 70 
and 5i as in Lemma 14.11 and Lemma 14.21 respectively. Then Lemma 14.11 implies inequality 
(|4.42p with qn replaced by pn and 7^ replaced by 70. Hence, using Lemma 14.21 oiie 
obtains the claim for the subset of vectors Ci. The remaining vectors xx in Cq lie in 
Ci := Incomp{6iPn,i, Pn,i)- According to Lemmas 14.41 14.51 we again have inequality ()4.42p 
for these vectors but with new parameters Qn = npnSiPn.i and 7„ = cpn.iy^^i Pn,i- Thus 
we may again subdivide the vectors in Ci into the vectors within distance pn,2 from these 
sparses ones i.e. C2 ■= Ci n Comp{62 Pn,2, Pnfi) and the remaining ones, i.e. C2 '■= Ci H 
Inconip{52 Pn,2, Pn,2) ■ Iterating this procedure L times we arrive at the incompressible set 
Cl oi vectors xx where Lemmas 14.41 14.51 and Proposition 14.61 vield the required bound of 
order exp{—6n}, for sufficiently small absolute constant 5 > 0. 

Summarizing, we will determine iteratively constants 5i, pn,u for I = 1, . . . , L and the 
following sets of vectors 

Ci := n[^^Incomp{6iPn,i, Pn,i) (4.67) 

and 

Ci := Ci_i n Comp{Si Pn,i, Pni) with Co = S^""-^^ . (4.68) 

Note that 

^(n-i) ^ ufj/ci U Cl- (4.69) 

The main bounds to carry out this procedure are given in the following Lemmas 14.61 and 
[121 

Lemma 4.6. Let 6n,Pn £ (0, 1) and let x G Incomp{6n, Pn) and ^^^\z) be a matrix as in 
Theorem \4- 1\ Then there exists some positive constants ci and C2 depending on K , ro, r/o 
such that for any < r < 7^ 

Pr{||X(^)(z)x||2 < r} < exp{-cin((p„n5„) A 1)} (4.70) 

with 

In ■= C2Pn\f^n-, (4.71) 

where a f\h denotes the minimum from a and b. 

Proof. Assume at first that ndnPn ^ 1 /3. According to Lemma 14.41 we have, for any 
j = 1 . . . , n, 

n 

supPr{| '^XjkEjkXk -u\< rjopn/V2n} < 1 - ri(5„np„. (4.72) 

Applying Lemma with qn = ri(5„ npn, we get 

Pr{||x(")(z)x||2 < 7n/2 and ||x(^)(z)|| < Kn} < exp{-cn5„np„}. (4.73) 
Consider now the case nSnPn > 1/3. According to Lemma 14.41 we have 

n 

s\XY>VT{\^^XjkejkXk -u\< riQPnl^Phi) < 1 - n. (4.74) 
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Applying Lemma 14.51 with g„ = ri(5„ npn, we get 

Pr{||x(")(z)x||2 < 7n/2 and ||x(")(z)|| < K„} < exp{-cn}. (4.75) 

This completes the proof of the Lemma. □ 

Lemma 4.7. For I = 2, . . . ,L assume that 5i,pn,i have been already determined for i = 
1, . . . , / — 1. Then there exist absolute constants q > and Q > and 5i > Q such that 

Pr{ inf ||X(^)(z)x||2 < ln,l and \\yS'\z)\\ < K„} < exp{-q Vn) A 1)}, 

(4.76) 

with 'jn,l defined by 

Inl = Cl Pn,l^lV^l-lPn,l-l, (4-77) 

and pn,i defined by 

Pn,l • 1n,l /{4Kn), (4.78) 
where Ci := C/_i n Comp{6iPn,i, Pn,i)- 

Remark 4.9. There exists some absolute constant c > that 

Proof of the Remark. Note that p~\ = 0{n~^~^^^) This implies that 

InX = Pnpin"^^'^'^'^) (4.80) 
According to Lemmas 14.11 and 14.21 we have p~l = 0{n'^). After simple calculations we 

= 0(n^/'). (4.81) 

□ 



Proof of Lemma \4- 7\ To prove of this Lemma we may use arguments similar to those in the 
proofs of Lemmas 2.6 and 3.3 in [21]. From x € Q it follows that x G Incomp{6i^iPn^i~i, Pn.l~i)- 
Applying Lemma HSl with 5„ = Pn,i^i and p„ = Pn,i~i, we get 

Pr{||X(^)(z)x||2 <7n,i and ||X(^)(z)|| < < exp{-cin((np„p„,,_i) A 1)} (4.82) 
with 

ln,l = C2 Pn,l-l\/Sl^lPn,l-l- (4.83) 

Inequality (j4.82p and Lemma |4 . 2 1 together imply 

Pr{ inf ||X(^)(2)x||2 < 7n,« and ||X(^)(z)|| < K^} < exp{-cinp,,;} (4.84) 
xeC; 

with 6i defined in Lemma 14.21 and 

Pn,l ■ — 7n,' 

/{4Kn). (4.85) 

Thus the Lemma is proved. □ 
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The next Lemma gives an estimate of small ball probabilities adapted to our case. 

Lemma 4.8. Let x G Incomp{5, pn^L}- Let he random variables with zero 

mean and variance at least 1. Assume that the following condition holds, 

L{M) := max max E |Xfc|^/||xJ>An ^0 as M ^ oo. (4.86) 

n>l l<fc<n 

Then there exists some constants C > depending on 6 such that for every e > 
P^{ePn,L/V2n) := supPr{| ^ XfcCfcXfc - v\ < epn,L/V2n} < (4.87) 



Proof Put Li := [- log2(/9„,LV2(5)]. Note that 

^ < , ] ^ < (4.88) 

According to Remark 14.91 we have pn,L ^ cn~^. This implies Li < Clnn. Let (t(x) 
denote the spread set of the vector x, i.e. 

ct(x) := |a: : /9„,l/v^ < \xk\ < • (4.89) 

By Lemma |4.3| we have 

|cj(x)| > n6/2. (4.90) 
We divide the spread interval of the vector x into Li+2 intervals A;, / = 0, . . . , Li + 1 by 

A„: = {.: ^<M<^j^}, (4.91) 

Note that there exists an /q = 0, . . . , Li + 1 such that 

|A;J > n6/{2{Li + 2)) > Cn/lnn. (4.93) 

Let y = Put ai := min^g^^ and bi := max^g^^ \xk\- Choose a constant M such 

that L{M) < 1/2. By the properties of concentration functions, we have 



P^{£pn,L/V2n) < py{£pn,L/V2n) < PyiMbi,). (4.94) 
By definition of A^^, we have 

kfcP > al\Ai,\ > plj{2n)\Ai,\, (4.95) 
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and 

^ > 1. (4.96) 

bio ^ 

Define 

D{^,\) = X-'B\^\^I{\^\^^} (4.97) 

and introduce for a random variable ^, '■=£, — £, where ^ denotes an independent copy 
of Put ^fc := XkEkXk- We use the following inequality for a concentration function of a 
sum of independent random variables 

Py{Mhi,) < CMbi, I AiZ?(6Jfc;Afc) ) (4.98) 

with Afc < Mbig. See Petrov [22j . p. 43, Theorem 3. Put = M|xfc|. It is straightforward 
to check that, 

^ XlD{^k;Xk)>Pn Yl kfcl'(E|Xfc|2-L(M)) j . (4.99) 

This implies 

Y: >^lDi^i^k;Xk) > ^ E l^'^l' ^ ylAJaf^. (4.100) 
Combining this inequality with ()4.98p and (j4.94p we obtain 



— CMbu CM 

pAePn,L/V2^) < ^-—^ < < (4.101) 

The last relation concludes the proof. □ 
Invertibility for the incompressible vectors via distance. 

Lemma 4.9. Let Xi, X2, . . . , X„ denote the columns of ^nj>„X^^)(z), and let Ti^ denotes 
the span of all column vectors except k-th. Then for every 5, p £ (0, 1) and every r] > 
one has 

Pr I inf ||x(^)(z)x||2 < vipn.L/V^?/V^] < ^ V Pr{dist(Xfc, W^) < VPn,L/V^}. 
[xeCi J n6L ^ 

Proof. Note that 

PrJ inf \\X'^'\zM2<v{pn,L/V^f/V^\ 
[xeCi J 

<Pr| inf \\X^'\z)^\\2<vipn,L/V^?/V^] ■ (4-102) 

|^xe/ncomp(5i,,p„_i) J 
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For the upper bound of the r.h.s. of (|4.102p see [2T|, proof of Lemma 3.5. For reader 
convenience we repeat this proof. Introduce the matrix G := ^np„X(^)(z). Recall that 
Xi, . . . ,X„ denote the column vector of the matrix G and TCk denotes the span of all 
column vectors except the k — th. Writing Gx = X]fc=i ^k^kj we have 



Put 
Then 



|Gx|| > max dist {x k, TC k) = max |2;fc|dist(Xfc, "H^). (4.103) 

k=l,...,n k=l,...,n 



Pk ■■= Pr {dist(Xfc, Wfc) ^ 'nPn,L /V^} . (4.104) 



E 



{k : dist(Xfc,Wfc) < VPn,L/V^}\ = Y,Pk- (4.105) 



k=l 



Denote by U the event that the set ai := {k : dist(Xfc,iffc) > "qpn.L/ ^/n} contains more 
than (1 — 5L)n elements. Then by Chebyshev's inequality 

1 " 

Pr{C/=} < — Vpfc. (4.106) 

On the other hand, for every incompressible vector x, the set (72 (x) := {k : \xk\ > 
Pn,L/V^} contains at least ndi elements. (Otherwise, since ||Po-2(x)'=x||2 < Pn,L, we have 
||x — y||2 < Pn,L for the sparse vector y := ^^-^(x)^, which would contradict the incom- 
pressibility of x). 

Assume that the event U occurs. Fix any incompressible vector x. Then |cji| + 
|(T2(x)| > (1 — 6L)n + hSl > n, so the sets ai and (T2(x) have nonempty intersection. Let 
A; G (Ti n (T2 (x) . Then by (14.1031) and by definitions of the sets cJi and o"2 (x) , we have 

||Gx||2 > |Xfc|dist(Xfc,?^fe) > 7]Pn,Ln-^^^. (4.107) 

Summarizing we have shown that 

1 " 

Pr{ inf \\G^\\2<v{Pn,Ln~^^^f}<FT{U'}<—y2pk. (4.108) 

:x.£lncomp(5L,pn,L) 



This completes the proof. 



□ 



We now reformulate Lemma 3.6 from [21]. Let X* to be any unit vector orthogonal 
to Xi, . . . ,X„_i. Consider the subspace Tin = span(Xi, . . . ,X„_i). 



Lemma 4.10. Let 6i,pi,ci, I = I, . . . , L — 1 be as in Lemma \4.S\ and 6l,Pl,cl as in 
Lemma \4- T\ Then there exists an absolute constant cl > such that 

Pr |x* ^ Cl and ||X(^)(z)|| < K^] < exp{-CLnp„}. (4.109) 
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Proof. Note that 

^(n-i) ^ ufj-^Ci U Cl. (4.110) 
The event {X* ^ Cl and ||X'^'')(z)|| < Kn} imphes that the event 

£■■={ inf ||x(^)(z)x||2 < c and \\X^'\z)\\ < Kn} (4.111) 

xGufj;^^C,: ||x||2 = l 

occurs for any positive c. This imphes, for c > 0, 

Pr{X*^CL and ||x(")(z)|| < (4.112) 

L-l 

<VPr{ ^inf ||X(")(z)x|| < c and \\X^'\z)\\ < Kn}. (4.113) 

l^l ^eCi: ||x||2 = l 

Now choose c := min{7n / = 1, . . . , L — 1}. Applying Lemma 14.71 proves the claim. □ 

Lemma 4.11. Let ^^^\z) be a random matrix as in Theorem \l.S\ . Let Xi, . . . , X„ denote 
column vectors of matrix y/np„^^^\z), and consider the subspace Tin = span(Xi, . . . , Xn-i) 
Let Kn = Kuy/p^. Then we have 

Pr{dist(X„,W„) < Pn,L/V^ and \\X.^'\z)\\ < Kn} < \^ . (4.114) 



Proof. We repeat Rudelson and Vershynin's proof of Lemma 3.8 in [2T]. Let X* be any 
unit vector orthogonal to Xi, X2, . . . , X„_i. We can choose X* so that it is a random 
vector that depends on Xi, X2, . . . , X„_i only and is independent of X„. We have 

dist(X„,W„) > I <X„,X* > |. 

We denote the probability with respect to X„ by Pr„ and the expectation with respect to 
Xi, . . . , X„_i by E Then 

Pr{dist(X„,?^„) < Pn,L/^/^ and ||X(^)(z)|| < Kn} 

< E i,...,„_iPr„{| < X*, X„ > I < Pn,L/V^ and X* G Cl} 

+ Pr{X* ^ Cl and ||x(^)(z)|| < Kn}. 

(4.115) 

According to Lemmas I4.10|, the second term in the right hand side of the last inequal- 
ity is less then exp{— Cin}. Since the vectors X* = {ai, . . . ,an) € 5^""^) and X„ = 
(ei^i, . . . ,£nCn) are independent, we may use small ball probability estimates. We have 

n 

S =< X„, X* >= ^ OkSkCk- 

k=l 
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Let a denote the set of spread of coefficients of X* as in Lemma 14.31 Let denote the 
orthogonal projection onto M*^ in M". Denote by = X^^.^^. ^k^-k^k- Using the properties 
of concentration function, we get 

Pr„{| < X„,X* > I < Pn,L/\/n} < supPr„{|5 - v\ < Pn,Ll\fn) 

V 

< supPr„{|5<x -v\< Pn,L/\/n}. 

V 

By Lemma |4.8|, we have for some absolute constant C > 



Pr„{| < X„,X* > I < Pn,L/V^} < (4.116) 

Thus the Lemma is proved. □ 

Lemma 4.12. Let X(^)(2;) be a random matrix as in Theorem \4-l\ Let dL,Pn,L £ (0)1)- 
Let Xi,...,X„ denote column vectors of matrix y/np^'X.^'^\z) . Let Kn = Kn^Jp^ with 
K >1. Then we have 

Pr{ inf ||X(-)(z)x||2 < plJn} < Pr{||X(^)(z)|| > + 

Proof. Note that 

Pr{ inf ||X(^)(z)x||2<p^ M 

< Pr{ inf ||X(^)(z)x||2 < pI l/u and ||X(^)(z)|| < K^} + Pr{||X(^)(z)|| > Kn}. 
xeCL 

(4.117) 

Applying Lemma 14.91 with rj = a/p^, we get 



1 

Pr{ inf ||X(^)(z)x||2 < pIl/^} < -- V Pr{dist(Xfc, Wfc) < Pu.lVp^/V^}- 

Applying Lemma 14.111 we obtain 

Pr{ inf ||X(-)(z)x||2 < pIl/u} < ^1^. (4.118) 

Lemma is proved. □ 
Proof of Theorem 14.11 By definition of the minimal singular value, we have 

Fr{s^^\z) < plJn and s^^\z) < K^} 
< Pr{there exist x G cS^""^) : ||X(^)(z)x||2 < pI^l/^ and s^^\z) < Kn}. 
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Furthermore, using the decomposition of the sphere 5^" = uf^^^CiUCi into compressible 
and incompressible vectors, we get 



< . 1^ and sf{ 

L-l 

< Pr{ inf l|X(^^(^)x||2 < pI,l h and s^^\z) < K^} 



Pi{s^^^iz)<pi^Jn and sf^(z) < if„} 

L-l 



According to Lemma |4.7| we have 



+ Pr{ inf ||x(^)(z)x||2 < pIl/^ and s^{\z) < Kn}. (4.119) 

xGCl 



Lemmas 14.121 and 14.71 together imply that 



Pr{ inf ||X(^)(z)x||2 <plL/n and s^^\z) < Kn} < exp{-qnp„(np„)'"i}. 



Pr{ inf ||X(^)(z)x||2 < pli/n and s^^\z) < Kn} 



<Pr{ inf \\X^'\z)x\\2 < pIl/^ and sf\z)<Kn} 

< , + exp{-CLn}. 4.120 

The last two inequalities together imply the result. □ 

Remark 4.10. To relax the condition = 0{n^~^) of Theorem 14.11 to p'^ = o(n/ln^n) 
we should to put L = Inn. Then the value Li of Lemma 14.81 is at most C(lnn)^ and 
hence we have the bound C In n / y/np^ in (|4.87p . The last yields the bound Clnn/^npn + 
exp{— C2,n} in (j4.120p . Thus Theorem 14.11 holds with B chosen to be of order Clnn. 

5 Proof of the main Theorem 

In this Section we give the proof of Theorem II. 2[ Theorem 11.11 follows from Theorem 11.21 
with pn = 1. Let 7 := I and let i? > and ki define in Lemma 16.21 with q = 18. Using 
the notations of Theorem 14.11 we introduce for any z G C and absolute constant c > the 
set f^n(-z) = {io ^ Q : c/n^ < Sn\z), si(e) < n^/p^, \X^^'^\ < R}- According to Lemma 

Pr{4")(X) > n^} < C{npn)-\ 
According to Theorem 14.11 with e = c, 

Pr{c/n-^ > s^^\z)} < + Pr{sS^^ > n^}. 

According to Lemma 16.21 with q = 18, we have 

Pr{|A£)| <R}< CAZ < CM^)]-^. (5.1) 
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These inequalities imply 

Pr{a„(z)^} < (v9(V^))-^. (5.2) 
Let r = r{n) be such that r(n) — > as ??, ^ cxd. A more specific choice will be made later. 

(r) 

Consider the potential UfiJ . We have 



C/W = -^E log I det(x(^) -zl- rCDI 

--EE log |Af -r^- - - EE log |Af -r(- z\I^,,^^^ 

U'T). Lin. ' 



where Ia denotes an indicator function of an event A and f2„(z)'^ denotes the complement 

of 0,n{z). 



Lemma 5.1. Assuming the conditions of Theorem \4-l\ for r such that 

ln(l/r) ((/^(y^np^))""^/"^^ ^ oo as n ^ oo 

we have 

U^^} ^0, asn->oo. (5.3) 

Proof. By definition, we have 



1 " 

^:^ = --EElog|Af (5.4) 



Applying Cauchy's inequality, we get, for any r > 0, 



n 



Wtl I < - E E ^ I log I - re - z\r^ (Pri^^W}) 



n . 



1 

l + T 



< l^E|log|Af -re-z|r+M (Pr{17(r)})^+^ (5.5) 



i=i 

Furthermore, since ^ is uniformly distributed in the unit disc and independent of Aj, we 
may write 

E I log I A,- -ri- z| 1^+^ = — E f I log |Af ^ - rC - ^1 T+^dC = E J^'^ + E J^^'^ + E J;j^'\ 

2vr J|^|<i 
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where 



Jp) = ^/ |iog|Af -rC-^ir+^dC, 

A'^ = ^l |log|Af -rC-.|r+^dC, 



Note that 



ICI<1, |A,-rC-2|>i 



i4''^i<iog{e)- 



Since for any 6 > 0, the function — u^logn is not decreasing on the interval [0, exp{ — -^j], 



we have for < tt < e < exp{— -^j 



fog u < e^u ^ fog ( - 



Using this inequaUty, we obtain, for 6(1 + r) < 2, 



|Jp)| < ^.^(1+-) ffog f 1) / ^ ^ \xf -rC- Zl-'^^'^^UC (5.6) 



J 

1 + T 



< i^'log (^) /^|<J^r'^'^'^'^^ ^ C(T,6)eV-2 (log ) ) . (5.7) 



27rr2 

If we choose e = r, then we get 



|J?| < C(r, 6) (log (5.8) 

The following bound holds for }iYl]=i^ ■ ^o*^ ^^^^ |loga;|^+^ < e^l log ej^+^x^ for 
X > ^ and sufficiently small e. Using this inequality, we obtain 

-^E^^') < C(r)e2|loge|-^E|A5'^ -rC-z|2 < C{t){1 + \z\^ + r^)e^\loge\ 
" j=i i=i 

< C(t)(2 + |z|2)r2|logr|. (5.9) 

The inequalities (|5.6p - (|5.9p together imply that 



l-^ElloglAj.^^-re-zll^+n <c(log(-y . (5.10) 

7=1 
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Furthermore, the inequahties (|5.4p . (jS.Sp . and (|5.10p together imply 
We choose r = 18 and rewrite the last inequality as follows 

\ul{J\ < c (log {^{Vmh;)r^ < c (log (i)) 

If we choose r = ■^== we obtain log(l/r)(((^(^np„))^T9 ^ 0, then ()5.3p holds and the 
Lemma is proved. □ 

— (r) 

We shall investigate U^^ now. We may write 



^ n 1 " 

<^ = -- EE log |Af - . - rC|/n„(,) = -- J]E log(.,(X(^)(.,r))/^„ 



j=i i=i 



logxdEF„(x,2:, r), (5-11) 

3 

where Fn{-, z, r) is the distribution function corresponding to the restriction of the measure 
z,r) on the set r2„(z). Introduce the notation 

_ rKr, + \z\ 

U^ = - logxdF{x,z). (5.12) 

Jn-B 

Integrating by parts, we get 

172-17, = - EF„(x...r)-FU.r)^^ 

Jn-B X 

+ Csup|EF„(x,z,r) -F(z,r)||log(n-^+^)|. (5.13) 



This implies that 



\U^;!-U^\<Clnnsnp\BFn{x,z,r)-F{x,z)\. (5.14) 



Note that, for any r > 0, \sj (z) — Sj {z,r)\ < r. This implies that 

EF„(x-r,z) < EFn{x,z,r) < EF„(x + r,z). (5.15) 

Hence, we get 

sup |EF„(x, z,r) — F{x, z)\ < sup |EF„(x, z)-F{x, 2;)|+sup \F{x+r, z)-F{x, z)\. (5.16) 

X XX 
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Since the distribution function F{x, z) has a density p(x, z) which is bounded (see Remark 
I3.ip we obtain 

sup|EF„(j;,z,r) -F{x,z)\ < sup|EF„(x,z) - F{x,z)\ + Cr. (5.17) 

X X 

Choose r = -^=- Inequahties ()5.17p and (j2.47p together imply 



sup|EF„(rE,z,r) - F{x,z)\ < C((^(v^))"^ + -^)- (5.18) 

X y/ npn 



From inequahties (j5.18p and (j5.14p it fohows that 



Note that 



\U^;! - < Ci^i^))-^s + log(n^). 



iUal -Uf,\<\ / logxdF{x,z)\ < Cn-^\ ln(n- 
Jo 



Let IC = {z £ C : \z\ < R} and let /C^ denote C \ /C. According to Lemma 16.21 with 
q = 18, we have, for ki and R from Lemma [ 



l-qn:= EiJ.^;\lC') < ^ + Pr{|AfcJ > i?} < C(<^(np„))- . (5.19) 

n 

Furthermore, let /in and fin be probability measures supported on the compact set K 
and K^^^ respectively, such that 

E/.M = 9„7lM + (l-rf(:). (5.20) 
Introduce the logarithmic potential of the measure /in , 



= - j log\z-C\dTlP{C). 
Similar to the proof of Lemma 15.11 we show that 

hm |C/W - [/ mI < Clnn{ip{npn))-^. 

This implies that 

lim U {r){z) = Uf,{z) 

for all z G C. Since the measures Jln^ are compactly supported. Theorem 6.9 from [16] and 
Corollary 2.2 from |16j (see also the Appendix, Theorem 16.11 and Corollary 16. 8p together 
imply that 

lim /!(:•) = /i (5.21) 
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in the weak topology. Inequality (|5.19p and relations (|5.20p and (|5.20p together imply that 

lim E ^^^^ = fi 

in the weak topology. Finally, by Lemma 1 1.1 1 we get 

lim Bfxn = (5.22) 

n— too 

in the weak topology. Thus Theorem 11.21 is proved. 

6 Appendix 

In this Section we collect some technical results. 

The largest singular value. We show the following 

Lemma 6.1. Under condition of Theorem for sufficiently large K > 1 we have, 

Pr{4'^ > n^} < C/npn (6.1) 
for some positive constant C > 0. 
Proof. Using Chebyshev's inequality, we get 

Pr{s["\> n^} < ^ETV(X(^)(X(^))*) < l/(np„) (6.2) 



Thus the Lemma is proved. □ 

Recall that lA^*"^! > . . . > |An^| denote the eigenvalues of the matrix X*-*"^ ordered in 
decreasing of absolute values and s^f^ > ... > Sn^ denote the singular values of the matrix 

x(-). 

Lemma 6.2. Assume that maxj ^ E |Xjfcp93(Xjfc) < C with ip{x) := (ln(l + |x|))'^, q>7, 

and An := sup^, \Fn\x, z) — F{x, z)\. Then there exists some absolute positive constant R 
such that ^ 

Pr{|Alf|>i?}<((^(np„))-%, (6.3) 

where k\ := [A^f'''^^''^^''^nlnn] . 



Proof. Let us introduce := [A^f^^^^^^'^^'n] . Using Chebyshev's inequality we obtain, for 
sufficiently large i? > 0, 
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On the other hand 

ki ki ^ ki 

Pr{\^k^\ >R}< Pr{n l^^'"^! > ^'"'1 < Pr{]^ 4'^ > R'''} < Pr{ — ^ In sjf) > InR}. 

u=l u=l ^ u=l 

Furthermore, for any value -Ri > 1, splitting into the events s^^^ > R and s^j^^^ < R, we get 
Pr{— Yl Ins^f) > Ini^i} < Prjsfj > R} + Pr{-^ InsS"^ + \nR> InRi} 



<AK+Pr{lnsS^)>^ln^}. 

KO R 

Now choose Ri := R?. Thus, since ki/ko ~ Inn, 

Pr{|Aj.^^^| > R} < An^" + Pr{lnsi^^ > Ini? ln?i}. 
Taking into account Lemma |6. II and inequality (j2.47p we obtain 

^ npn 
for some positive constant C > 0, thus proving the Lemma. □ 

Lemma 6.3. Let x = max^^fc E \Xjk\'^ip{Xjk)- The following inequality holds 

Proof. Introduce the notations 

1 " 

B ■■= E E.,^|x,,|(|r(2;j + (6.5) 



and 



n^npn 



2 

2 " 

2 " 

2 " 

j,k=l 



(6.6) 
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Since the function \x\/Lp[x) not decreasing, it follows from inequality ()2.10p that 

!«' - < i'(,x,,>^, + :gr;^^^AX,,). (6.7) 



It is easy to check that 



maxj^fc, A; = 1,...,8} < ^"^^ • (6-^ 



This implies that 

□ 

Lemma 6.4. Lei /i„ 6e i/ie empirical spectral measure of the matrix X and Vr be the 

(r) 

uniform distribution on the disc of radius r . Let Hn be the empirical spectral measure of 
the matrix X(r) = X — r^I, where is a random variable which is uniformly distributed 

(r) 

on the unit disc. Then the measure E is the convolution of the measures E /i^ and v^, 
i. e. 

E/iM = (E (i/,). (6.10) 

Proof. Let J be a random variable which is uniformly distributed on the set {1, . . . ,n}. 
Let Ai, . . . , A„ be the eigenvalues of the matrix X. Then Ai+r^, . . . , A„+r^ are eigenvalues 
of the matrix X(r). Let 6x be denote the Dirac measure. Then 



n 

n = -E^X, (6.11) 



and 



n . 



1 

/^^^^ = -E'^A,+.e- (6-12) 



Denote by ^nj the distribution of \j. Then 

1 " 

E//n = -^/^ni (6.13) 



n . 



and 

^ l^n = - ^ l^nj * l^r = -"^l^nj * (l^r) = (E /i„,) * (f^). (6.14) 

Thus the Lemma is proved. □ 
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Let 



and 



where 



and 



/OO /'OO 

/ exp{itx + i^;y}dG«(x,y) (6.15) 
-OO J — OO 

/OO f'OO 

/ eyiY){itx + ivy}dGn{x,y), (6.16) 
-OO J —OO 

1 

GW(x,y) = -^Pr{ReA,+re<x,ImA,+re<y}, (6.17) 



n . 



1 " 

G„(x,y) = - ^Pr{ReAj < x,ImAj < y}. (6.18) 



n 
i=i 

Denote by h{t, v) the characteristic function of the joint distribution of the real and imag- 
inary parts of ^, 

/OO fOO 
/ exp{iux + ivy}dG{x,y). (6.19) 
-OO J ~oo 

Lemma 6.5. The following relations hold 

fi'Ht,v) = Ut,v)hirt,rv). (6.20) 
If for any t,v there exists liinn.~,oo fnit,v), then 

hm hm fl^\t,v) = hm hm /^(t, ^;) = hm fn{t,v). (6.21) 

r— >0n— >oo n— >oo r— >0 n— >oo 

Proof. The first equahty fohows immediately from the independence of the random vari- 
able ^ and the matrix X. Since limr^o h{rt, rv) = h{0, 0) = 1 the first equality implies 
the second one. □ 

Lemma 6.6. Let F and G be distribution functions with Stieltjes transforms Sf{z) and 
Sg{z) respectively. Assume that \F{x) — G{x)\dx < oo. Let G{x) have a bounded 
support J and density bounded by some constant K . Let V > vq > Q and a be positive 
numbers such that 

If 1,3 



7 = - / 7 du > -. 

Then there exist some constants Ci, C2, C3 depending on J and K only such that 

sup \F{x) - G{x)\ < Gi sup / {Spin + iV) - Saiu + iV)\ du 

-fsup / \SF{u + iv) - SG{u + iv)\dv + G2, vq. (6.22) 

MS J J Vn 
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Lemma 6.7. Let Xjk, ^ ^ j,k < n, be independent complex random variables with 

I 1 2 I 1 9 

EXjfc = and E = 1- Assume furthermore that maxj^i^'E\Xjf:\ I^^Xj^:\>M} ~^ 

for M — > +00. Then we have, for some positive tq and rjQ, 

supmaxPr{|Xjfc — u\ < tjq} < tq < 1. 

liGC J.'^ 

Proof. First we note, that there exists a positive number M such that 

2 7 
ramE(\Xjk\ I{\x,,\<M}) > g- 

Let rjQ be a small positive number. For |n| > M + i]q we have 

Pr{|X,fc -n| > r?o} > Pr{|X,fe| < Af} > {\X,k\^ I{\x,,\<M}) > (6.23) 

Consider now |n| < M + ?7o- Then 

Pr{\Xjk - n| > r?o} > E {I{2M+vo>\x,k-u\>vo}) ^ 4]^'^ ('^J'^ ~ '^\^h'2M+vo>\Xjk-u\>vo}) 

- 4M2 ~ ^ (I^J''^' ~ '"l^-^{l^ife-«l<'?o}) - E (l^jfe - ^^P-^{|X,.fe-«|>2M+%})) 

Combining inequalities 16.231 and 16.241 we obtain the claim. □ 
6.1 Some facts from logarithmic potential theory 

We cite here some definitions and Theorems about logarithmic potentials, see [16]. Let 
S C C be a compact set of the complex plane and M{T,) the collection of all positive Borel 
probability measures with support in S. The logarithmic energy of G A^(S) is defined 
as 

Iifi):= j j log j-^^dti{z)dix{t), (6.25) 

and the energy of E by 

V ■.= mf {I {fi)\fi e M{J:)}. (6.26) 

The quantity 

cap(S) := e"^ (6.27) 

is called the logarithmic capacity of S. 

The capacity of an arbitrary Borel set E is defined as 

n {E) := sup{cap{K)\K C E,K compact}. (6.28) 

Note that every Borel set of capacity zero has zero two-dimensional Lebesgue measure. A 
property is said to hold quasi- everywhere (q. e.) on a set E if the set of exceptional points 
is of capacity zero. The next Theorem is called Lower Envelope Theorem 
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Theorem 6.1. Let fin, n = 1,2..., be a sequence of positive Borel probability measures 
having support in a fixed compact set. If fin ^ fJ- weakly, then 

liminf = U^^^z) (6.29) 

n—^oo 

for quasi- every z £ C 

The foUowing fact is Corohary 2.2 from the Unicity Theorem of logarithmic potential 
theory (see [16], p. 98). 

Corollary 6.8. If fi and v are compactly supported measures and the potentials and 
If^ coincides almost everywhere with respect to two-dimensional Lebesgue measure, then 
fl = u. 

For reader convenience we give here the statement of Theorem 1.2 from |16j . 

Theorem 6.2. Let fi be a finite positive measure of compact support on the plane. Then 
for any zq and r > the mean value 

L{U^;zo,r):=^ [ Uf'izQ + r exp{i6})d9 (6.30) 

exists as a finite number, and L{U^; ZQ,r) is a non-increasing function of r that is abso- 
lutely continuous on any closed subinterval o/(0,oo). Furthermore, 

lim LiU^"] zo,r) = U^'izo). (6.31) 
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